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(54) IMAGE PICKUP AND IMAGE CONVERSION DEVICE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To automatically detect the variation of a camera pitch 
angle from picked-up lane marks and automatically adjust a converted image. 
SOLUTION: The image pickup and image conversion device loaded in a vehicle and fixed 
on a point C of height (h) and capable of picking up the image of a road surface on the 
back of the vehicle from a camera and converting the picked up image into a bird's-eye 
image detects lane marks to be parallel lines and judges whether the lane marks are 
parallel lines or not. When the lane marks are not parallel lines, the variation dP of the 
camera pitch angle Pc is obtained from width Wi1 on a position most close to the 
vehicle in the bird's eye image, width Wi2 on a position most far from the vehicle and an 
angle P in the vertical direction of the camera in an area to be converted into thfe 
bird's-eye image and Pc+dP is substituted for the camera pitch angle to prepare a 
bird's-eye image again. 
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CLAIMS 



[Claim(s)] 

[Claim 1] The image pick-up and the image-transformation equipment which amend the image pick-up direction parameter of the image 
pick-up means which said image-transformation means has based on the analysis result of said image-analysis means, and are 
characterized by to constitute so that the amended resolution picture may make output in the image pick-up which has an image pick- 
up means, an image-transformation means changes the image pick-up image of the image pick-up means, and output an resolution 
picture, and an image-analysis means analyze said image pick-up image, and image-transformation equipment. 

[Claim 2] The image pick-up and the image-transformation equipment which amend the image pick-up direction parameter of the image 
pick-up means which said image-transformation means has based on the analysis result of said image-analysis means, and are 
characterized by constituting so that the amended resolution picture may make output in the image pick-up which has an image pick-up 
means, an image-transformation means change the image pick-up image of the image pick-up means, and output an resolution picture, 
and an image-analysis means analyze the resolution picture which the image-transformation means outputs, and image-transformation 
equipment. 

[Claim 3] Said image pick-up means is the image pick-up according to claim 1 or 2 and image transformation equipment which are 
characterized by being attached in a car and mainly picturizing a road surface. 

[Claim 4] Said image analysis means is the image pick-up according to claim 3 and image transformation equipment which are 
characterized by determining the amount of amendments of said image pick-up direction parameter by presuming and extracting the 
parallel lines or the known graphic form on a road surface, and analyzing the image pick-up image or resolution picture of these parallel 
lines or a known graphic form. 

[Claim 5] Said image analysis means is the image pick-up according to claim 3 and image transformation equipment which are 
characterized by determining the amount of amendments of said image pick-up direction parameter by the rate measurement means of 
a car being interlocked with by analyzing the image pick-up image or resolution picture of an optical flow on a road surface. 
[Claim 6] It is the image pick-up according to claim 3 and image transformation equipment which are characterized by determining the 
amount of amendments of said image pick-up direction parameter by analyzing the resolution picture having predetermined distance, 
arranging two or more of said image pick-up means, and according to the image pick-up image of the image pick-up means of these 
plurality [ means / said / image analysis ], or said image transformation means. 

[Claim 7] An image pick-up and image transformation equipment given in any 1 term of claim 3 characterized by for an attitude-sensing 
means to detect the direction of an image pick-up means being arranged by said image pick-up means, using together the direction 
parameter of the image pick-up means against the car which this attitude-sensing means detects, and determining the amount of 
amendments of said image pick-up direction parameter thru/or claim 6. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the image pick-up and image transformation equipment which change into an resolution 
picture the image pick-up image picturized by the image pick-up means with an image transformation means, and output it. What 
changes the image pick-up image specifically obtained by picturizing a road surface etc. aslant into the top view picturized and obtained 
from the upper part before outputting to for example, image recognition equipment is mentioned. This invention is effective in the image 
pick-up which provides an operator etc. with the top view (bird's-eye view) from the upper part in operation of operation of a car etc., a 
vessel, the aircraft, etc., and external observation especially, and especially image transformation equipment. 
[0002] 

[Description of the Prior Art] For example, JP,2946727,B and JP,7-218280,A are known as the image pick-up which picturizes the road 
surface and road situation of the front or back to the operator of a car, and provides him with the top view (bird's-eye view) from the 
upper part, and image transformation equipment. These fix image pick-up equipment as a design including the image pick-up direction 
beforehand, and input the parameter. 
[0003] 

[Problem(s) to be Solved by the Invention] Like a passenger car, by a car body's sinking or inclining with the entrainment number and 
the amount of loads, when the location and the image pick-up direction of image pick-up equipment differ from the parameter inputted 
or it was designed, in a place, they may happen frequently. Then, while running the road surface which has completely parallel lane space 
marks, for example, even if it is going to obtain the top view (bird's-eye view) from the upper part from an image pick-up and image 
transformation equipment, distortion will arise. 

[0004] This is shown in draw i ng 8 . As shown in (a) of drawing 8 , when the pitch angle Pc (the apparent vertical passing through the lens 
core of Camera C and angle which the image pick-up direction of a camera constitutes) of the camera C formed in Car M is alpha, the 
image pick-up image ((b) of drawing 8 ) presupposes that the processor is constituted so that it may become a right resolution picture 
((c) of drawing 8 ). That is, when the parallel lines on a road surface (a thick segment and broken line) are picturized, an resolution 
picture presupposes that it is actjusted so that it may become parallel lines. When the pitch angle of a camera becomes large with 
alpha+d alpha (dalpha> 0) or becomes small with alpha-d alpha (dalpha> 0) at this time, that image pick-up image becomes like (d) of 
drawing 8 , (a horizontal line H becoming a low location among an image pick-up image), (e), and (a horizontal line H becoming a high 
location among an image pick-up image). Then, since the approach of image transformation is to change into the frame of the screen of 
(c) of drawing 8 , (f), and (g) the field surrounded by the dotted line of (b) of drawing 8 , (d), and (e), the resolution picture of (d) of 
drawing 8 and (e) will become like (f) of d rawing 8 , and (g). That is, an resolution picture did not become a top view (bird's-eye view) 
from the right upper part with the inclination of a car, but there was a problem that right information was not directed to an operator 
even if it outputs to image recognition equipment. 

[0005] Accomplishing this invention in order to solve the above-mentioned technical problem, the purpose is offering the image pick-up 
and image transformation equipment which were constituted so that the resolution picture amended by carrying out automatic 
amendment of the image pick-up direction of image pick-up equipment might be outputted. 
[0006] 

[Means for Solving the Problem] In the image pick-up which has an image pick-up means, an image transformation means to change the 
image pick-up image of the image pick-up means, and to output an resolution picture, and an image analysis means to analyze an image 
pick-up image according to the means according to claim 1 in order to solve the above-mentioned technical problem, and image 
transformation equipment It is characterized by constituting so that the image pick-up direction parameter of the image pick-up means 
which an image transformation means has based on the analysis result of an image analysis means may be amended and the amended 
resolution picture may be made to output. This is shown in d rawing 1 (a) as a block diagram. In addition, as an image pick-up direction 
parameter, they are the locations (camera height etc.) of an image pick-up means, the angle (pitch angle) of the direction of an image 
pick-up core, and the straight line taken down downward [ vertical ] from the image pick-up means to accomplish, the angle (horizontal 
Bure angle) of those flat surfaces to make and the direction of a setting image pick-up core set up to accomplish, and angle of torsion 
of the image pick-up means centering on the direction of an image pick-up core. 

[0007] Moreover, an image transformation means to change the image pick-up image of an image pick-up means and its image pick-up 
means according to the means according to claim 2, and to output an resolution picture, In the image pick-up which has an image 
analysis means to analyze the resolution picture which the image transformation means outputs, and image transformation equipment It 
is characterized by constituting so that the image pick-up direction parameter of the image pick-up means which an image 
transformation means has based on the analysis result of an image analysis means may be amended and the amended resolution picture 
may be made to output. This is shown in drawing 1 (b) as a block diagram. In addition, as an image pick-up direction parameter, they are 
the locations (camera height etc.) of an image pick-up means, the angle (pitch angle) of the direction of an image pick-up core, and the 
straight line taken down downward [ vertical ] from the image pick-up means to accomplish, the angle (horizontal Bure angle) of those 
flat surfaces to make and the direction of a setting image pick-up core set up to accomplish, and angle of torsion of the image pick-up 
means centering on the direction of an image pick-up core. 

[0008] Moreover, according to the means according to claim 3, in an image pick-up according to claim 1 or 2 and image transformation 
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knoym graphic form on a road surface, and is characterized by determining the amount of amendments of the image pick-up direction 
parameter by analyzing the image pick-up image or resolution picture of these parallel lines or a known graphic form. Road surface-like 
parallel lines mean the road shoulder, lane space marks, a parking field partition line, etc., and a known graphic form means road surface 
dispplay of a circular manhole, a stop line, and a travelling direction and others etc. here, for example. 

[0010] Moreover, according to the means according to claim 5, an image analysis means is characterized by determining the amount of 
amendments of the image pick-up direction parameter by the rate measurement means of a car being interlocked with by analyzing the 
image pick-up image or resolution picture of an optical flow on a road surface. An optical flow means what is recognized by the image 
analysis means as what moves in an image pick-up image or resolution picture top here like the lane space marks of the shape of a 
broken line formed in the road surface. 

[001 1] Moreover, according to the means according to claim 6, it has predetermined distance, two or more image pick-up means are 
arranged, and an image analysis means is characterized by determining the amount of amendments of the image pick-up direction 
parameter by analyzing the image pick-up image of the image pick-up means of these plurality, or the resolution picture by said image 
transformation means. 

[0012] Moreover, according to the means according to claim 7, it is characterized by for an attitude-sensing means to detect the 
direction of an image pick-up means being arranged by the image pick-up means, using together the direction parameter of the image 
pick-up means against the car which this attitude-sensing means detects, and determining the amount of amendments of the image 
pick-up direction parameter. An attitude-sensing means means the combination and others of a gyroscope, an acceleration detector, 
and a computing element here. 
[0013] 

[Function and Effect(s) of the Invention] When the image pick-up means has not turned to the image pick-up direction as a setting, it 
can ask for the gap with the set point of the image pick-up direction of an image pick-up means by analyzing an image pick-up image or 
an resolution picture with the means of claim 1 of this application, or claim 2. Therefore, the amended resolution picture can be acquired 
by amending the image pick-up direction parameter in an image transformation means, without adjusting the image pick-up means itself. 
Therefore, fine tuning becomes unnecessary in the case of immobilization of an image pick-up means. As such an image pick-up and 
image transformation equipment, after picturizing a road surface etc. aslant, for example, it is effective in especially the image pick-up 
and image transformation equipment that form the top view (bird's-eye view) from the upper part. By this, you can make it for example, 
image recognition equipment interlocked with, a more exact circumference situation can be recognized, and circumference status 
information can be given to an operator, a monitor, etc. 

[0014] If an image pick-up means is attached in a car and the image pick-up image or resolution picture of a road surface is analyzed, 
the amount of amendments of the image pick-up direction parameter can be determined easily (claim 3). According to analysis of the 
parallel lines on a road surface, a known graphic form, and an optical flow, it is especially easy and certain (claims 4 and 5). If two or 
more image pick-up means are established, the image pick-up direction can be certainly determined from a stereo image, and the 
amendment is also easy (claim 6). Amendment will become still easier if it has the attitude-sensing means of the image pick-up means 
itself in addition to these (claim 7). 

[0015] Combining claim 1 and claim 2 of this invention is also included by this invention. That is, it has the 1st image analysis means 
which analyzes an image pick-up image, and the 1st image analysis means which analyzes an resolution picture, 1 or two or more image 
pick-up direction parameters are amended based on the analysis result of the 1st image analysis means, and 1 or two or more image 
pick-up direction parameters are amended based on the analysis result of the 2nd image analysis means, analysis of an image pick-up 
image — the decision of the amount of amendments — 1 [ easy ] or two or more easy image pick-up direction parameters, and analysis 
of an resolution picture — the decision of the amount of amendments — it asks for 1 [ easy ] or two or more easy image pick-up 
direction parameters with the 1st image analysis means and the 2nd image analysis means, respectively. Thereby, the amount of 
amendments can be determined easily. 

[0016] Moreover, combining claim 4 thru/or claim 7 of this invention is also included by this invention. For example, about a thing like 
fluctuation of only camera height which causes only fluctuation of only a scale of an resolution picture substantially, the amount of 
amendments is calculated from relation with a car rate with the means of claim 5, and the other image pick-up direction parameters are 
amended by claim 4. Moreover, for example, a gyroscope is built into an image pick-up means as an attitude-sensing means of claim 7, 
from image analysis like angle of torsion, amendment of the difficult image pick-up direction parameter is enabled, and claim 4 or claim 5 
amends the other image pick-up direction parameters. In addition, any combination of claim 4 thru/or claim 7 is included by this 
invention. 
[0017] 

[Embodiment of the Invention] Hereafter, the concrete example of this invention is explained. Although the following examples are 
examples including amendment of a pitch angle, they are taught by the following example and other configurations of the invention in this 
application can constitute them easily. 

[0018] The [1st example] Drawing 2 is the block diagram showing the configuration of the image pick-up concerning the 1st concrete 
example of this invention, and image transformation equipment 10. As shown in (a) of drawin g 8 , it is carried in Car M, and the camera C 
which picturizes car back is assumed. The image picturized with the camera (image pick-up means) 1 of drawing 2 is inputted into the 
view transducer (image transformation means) 2. Here, it changes into a bird's-eye view image based on the image pick-up direction 
parameter which is a initial value. Here, a bird's-eye view image is outputted to the image analysis means 3. The image analysis means 3 
consists of the lane-space-marks detecting element 31 and the amount calculation section 32 of parameter amendments. In the lane- 
space-marks detecting element 31, the lane space marks which it should display as an parallel white line are detected. Here, lane space 
marks did not become a perpendicular parallel track group among the image, but the inclination may have arisen. Next, in the amount 
calculation section 32 of parameter amendments, when the inclination has arisen in lane space marks, the amount dP of amendments of 
the pitch angle Pc of a camera 1 is computed, and it outputs to the view transducer 2. The view transducer 2 performs image 
transformation again based on the amount dP of amendments of the pitch angle Pc of a camera 1. In this way, it is outputted, after 
repeating a routine and becoming a right bird's-eye view image until the inclination of the lane space marks which it should display as an 
parallel white line in a bird's-eye view image is lost. 

[0019] An image pick-up and the image transformation equipment 10 of this example make a flow chart the procedure performed as a 
whole, and it is shown in drawing 3 . S1, S2, etc. and existing "S" mean the step in a flow chart. By SI, the image which the camera 1 
picturized is captured first. Next, by S2, view conversion is performed using the image pick-up direction parameter. Even this is an 



inclination of lane space marks, it progresses to S7, and the amount dP of amendments of the pitch angle Pc is computed, it progresses 
to S8, the pitch angle Pc of the image pick-up direction parameter is replaced with Pc+dP, and it returns to S2. 
[0020] The approach of computing the amount dP of amendments of the pitch angle Pc of a camera 1 from the inclination of the lane 
space marks of a bird's-eye view image is as follows. As shown in (a) of drawing 4 , the foot of perpendicular taken down to the road 
surface G is set to G1 from the camera C formed in height h, and the range included in a bird's-eye view image is carried out to from G1 
to back G2. The magnitude of angle G1CG2 is placed with P. Moreover, as shown in (b) of drawing 4 , points R1 and R2 are assumed 
from a point G1 and a point G2 to G1G2 in the location of the perpendicular this side W. If the image pick-up direction parameter of the 
view transducer 2 of drawing 2 is in agreement with the actual image pick-up direction parameter of the camera C of drawing 4 , die- 
length I(G1) I (R1) and I(G2) I (R2) are equal about the corresponding points I (G1), I (G2), I (R1), and I (R2) in the bird's-eye view image 
of points G1, G2, R1, and R2. 

[0021] Next, the case where the pitch angle Pc of Camera C shifts dP is assumed, namely, (a) of dr aw ing 4 — like — the angle G1 of 
magnitude P — 'CG2' — angle G1 — it is assumed that only CG2 and dP shifted, at this time, as for the field of the square drill 
surrounded by angle G1CR1 of magnitude theta 1, and angle G2CR2 of magnitude theta 2, the pitch angle Pc of Camera C shifts dP — 
the angle G1 of magnitude theta 1 — 'CR1' and the angle G2 of magnitude theta 2 — it changes to the field of the square drill 
surrounded by 'CR2\ The following relation will be realized if it sets here with G1R1=G2R2=W, GI'RI' =W+dW1, and G2'R2' =W+dW2. 
[Equation 1] 

W=htmG x - (1-1) 

W+*W H =— ^rtanfl - (1-2) 

i cos dP l 

W=-^—tan 9^ - (1-3) 

cosP 2 

W+ dW n = 7™— r tan 0 - (1-4) 

[0022] Here, if dP is small enough, it can set as follows. 
[Equation 2] 

cosdP = 1 ■» (2-1) 

co* {P+dP) = cosP - sinPdP ( 2 - 2 ) 

[0023] dW1 and dP can be calculated as follows using a formula (2-1) and a formula (2-2) from a formula (1-1), (1-2) and a formula (1- 
3), and a formula (1-4). 
[Equation 3] 

dW x = 0 - ( 3 - 1 ) 

dW j 

dP = — (3-2) 

W+dW 2 *mP v ' 

[0024] Now, it thinks of what since these are the relation in a real-image system, has happened to them by the bird's-eye view image. 

drawing 4 — (— c — ) — like — a point — G — one — ' — G — two — ' — R — one — ' — R — two — ' — a bird's-eye view — an 

image — corresponding points — I (GO — I (G2') — I (RV) — 1 (R2') — ******** — die-length I(G1') I (RV) and I(G2') I (R2') — being 

equal . now, segment G2'R2' of real-image system top — Point r — G2' — if it takes so that it may become r=W, corresponding-points 

[ in the bird's-eye view image of Point r ] I (r) is located on segment I(G2') I (R2') in a bird's-eye view image, completely — being the 

same — things — a point — R — one — R — two — R — one — ' — R — two — ' — r — a straight line — G — one — G — two — 

axial symmetry — a point — L — one — L — two — L — one — ' — L — two — ' — I — ******** — carrying out . Then, when the 

lane space marks of two parallel straight lines of width-of-face 2W of the straight line which passes along Points R1, R2, and r, and the 

straight line which passes along Points L1, L2, and I are assumed, it is clearer than a formula (3-1) point RV and that point LV's it is on 

lane space marks respectively. Therefore, lane space marks like the thick wire of (c) of drawing 4 can be assumed. 

[0025] Like the already described JP,2946727,B publication, a bird's-eye view image changes the image pick-up image of a Gaussian 

imaging system, and its ratio of the segment in the bird's-eye view image corresponds with the ratio of the segment in the real-image 

system in the direction of an axis of abscissa (it is the direction of [ on a perpendicular road surface ] to the image pick-up center line 

of a camera). Therefore, the ratio of dW2=rR2' of a real-image system and G2'R2' =W+dW2 Are equal to the ratio of I(r) I (R2') in a 

bird's-eye view image, and I(G2') I (R2'). I(R2') I(L2'H (r) It is equal to the ratio of I (I), (=2I(r) I (R2')X and I(L2') I (R2') (=2I(G2') I (R2')X If 

it sets with I(L2') I(R2 ) =I(LV) I(RV) =Wi1 and I(r) 1(0 =Wi2, the formula (3-2) of a real-image system can be replaced by the formula (4) 

in the following bird's-eye view image. 

[Equation 4] 

W 1 

dP=— - — - (4) 

W n tanP K J 

[0026] The place which a formula (4) means is clear. That is, in the lane-space-marks detecting element 31 of the image analysis means 
3 of drawing 2 , Bure dP of the camera pitch angle Pc is called for from the width of face Wil in the car nearest to the inside of the 
bird's-eye view image of the lane space marks which continue the detected bird's-eye view image from the car latest to a back distant 
place noting that it is the lane space marks which should be parallel lines, the width of face Wi2 in the method of the last in a bird's-eye 
view image, and the image pick-up angle P of the lengthwise direction incorporated as a bird's-eye view image in a real-image system. 
Therefore, a right bird's-eye view image can be obtained by transposing the camera pitch angle Pc to Pc+dP among the image pick-up 
direction parameters, and performing view conversion again, without correcting the image pick-up direction of a camera itself. 



(— Jp — ) -~ like — height — h+dh — a point — C — ' — having become — the time — magnitude — theta — one — an angle — G - 

- one — C'R — one — ' — becoming — a point — R — one — ' — a point — G — one — ' — distance — W+dW — one — 
magnitude — theta — two — an angle — G — two — C'R — two — ' — becoming — a point — R — two — ' — a point — G — two 

— ' — distance — W+dW2 — placing . Then, the following relation is realized clearly. 
[Equation 5] 

W=htim6 1 - (5-1) 

W+dW x = {h + dh)\ane 1 - (5-2) 

W=-^—tmG n ■•• (5-3) 
cosP 2 

W+dW= tan 6 „ - (5-4) 

2 COS-P 2 

[0028] The following relation consists of a formula (5-1) and a formula (5-3). 
[Equation 6] 

tan 6 

tan 0 * - (6) 

l cosP 

[0029] If a formula (6) is substituted for a formula (5-4), it will become as follows. 
[Equation 7] 

(A + <tt)tan0 1 = W+ dW 0 — (7) 

[0030] A comparison of a formula (5-2) and a formula (7) materializes the following formula. 
[Equation 8] 

iW 1 = dW 2 •■• ( 8 ) 

[0031] From a formula (8), even if a camera moves to point C of height h+dh from the point C of height h, being maintained by the 
bird's-eye view image can understand parallel of lane space marks easily. Therefore, it can ask for the change dh of the height of a 
camera by the following approaches. 

[0032] Suppose that the lane space marks which described the slash disappeared from the bird's-eye view image after time amount t as 
shown in (d) in a bird's-eye view image which is (c) of drawing 5 . If the image analysis means is being interlocked with the rate 
measurement means of a car here, the distance D which progressed between time amount t will be found. On the other hand, since the 
include angle of a lengthwise direction of the range changed into a bird's-eye view image among the image pick-up range of a camera is 
P, h+dh, then its distance are cosP(s) (h+dh) about height. It can opt for the fluctuation dh of a camera location from the distance (h+dh) 
D and cosP which progressed between time amount t. In this way, a right bird's-eye view image can be obtained by repeating asking for 
a bird's-eye view image again by making a camera location into h+dh. 

[0033] The [3rd example] The parameter decision in an image pick-up image is explained briefly. For example, suppose that the image 
pick-up H of a horizontal line was detected in the image pick-up image. At this time, if the image pick-up H of a horizontal line is level as 
shown in (a) of drawin 
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[Field of the Invention] This invention relates to the image pick-up and image transformation equipment which change into an resolution 
picture the image pick-up image picturized by the image pick-up means with an image transformation means, and output it. What 
changes the image pick-up image specifically obtained by picturizing a road surface etc. aslant into the top view picturized and obtained 
from the upper part before outputting to for example, image recognition equipment is mentioned. This invention is effective in the image 
pick-up which provides an operator etc. with the top view (bird's-eye view) from the upper part in operation of operation of a car etc., a 
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[Description of the Prior Art] For example, JP,2946727,B and JP,7-218280,A are known as the image pick-up which picturizes the road 
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EFFECT OF THE INVENTION 



[Function and Effect(s) of the Invention] When the image pick-up means has not turned to the image pick-up direction as a setting, it 
can ask for the gap with the set point of the image pick-up direction of an image pick-up means by analyzing an image pick-up image or 
an resolution picture with the means of claim 1 of this application, or claim 2. Therefore, the amended resolution picture can be acquired 
by amending the image pick-up direction parameter in an image transformation means, without adjusting the image pick-up means itself. 
Therefore, fine tuning becomes unnecessary in the case of immobilization of an image pick-up means. As such an image pick-up and 
image transformation equipment, after picturizing a road surface etc. aslant, for example, it is effective in especially the image pick-up 
and image transformation equipment that form the top view (bird's-eye view) from the upper part. By this, you can make it for example, 
image recognition equipment interlocked with, a more exact circumference situation can be recognized, and circumference status 
information can be given to an operator, a monitor, etc. 

[0014] If an image pick-up means is attached in a car and the image pick-up image or resolution picture of a road surface is analyzed, 
the amount of amendments of the image pick-up direction parameter can be determined easily (claim 3). According to analysis of the 
parallel lines on a road surface, a known graphic form, and an optical flow, it is especially easy and certain (claims 4 and 5). If two or 
more image pick-up means are established, the image pick-up direction can be certainly determined from a stereo image, and the 
amendment is also easy (claim 6). Amendment will become still easier if it has the attitude-sensing means of the image pick-up means 
itself in addition to these (claim 7). 

[0015] Combining claim 1 and claim 2 of this invention is also included by this invention. That is, it has the 1st image analysis means 
which analyzes an image pick-up image, and the 1st image analysis means which analyzes an resolution picture, 1 or two or more image 
pick-up direction parameters are amended based on the analysis result of the 1st image analysis means, and 1 or two or more image 
pick-up direction parameters are amended based on the analysis result of the 2nd image analysis means, analysis of an image pick-up 
image — the decision of the amount of amendments — 1 [ easy ] or two or more easy image pick-up direction parameters, and analysis 
of an resolution picture — the decision of the amount of amendments — it asks for 1 [ easy ] or two or more easy image pick-up 
direction parameters with the 1st image analysis means and the 2nd image analysis means, respectively. Thereby, the amount of 
amendments can be determined easily. 

[0016] Moreover, combining claim 4 thru/or claim 7 of this invention is also included by this invention. For example, about a thing like 
fluctuation of only camera height which causes only fluctuation of only a scale of an resolution picture substantially, the amount of 
amendments is calculated from relation with a car rate with the means of claim 5, and the other image pick-up direction parameters are 
amended by claim 4. Moreover, for example, a gyroscope is built into an image pick-up means as an attitude-sensing means of claim 7, 
from image analysis like angle of torsion, amendment of the difficult image pick-up direction parameter is enabled, and claim 4 or claim 5 
amends the other image pick-up direction parameters. In addition, any combination of claim 4 thru/or claim 7 is included by this 
invention. 
[0017] 

[Embodiment of the Invention] Hereafter, the concrete example of this invention is explained. Although the following examples are 
examples including amendment of a pitch angle, they are taught by the following example and other configurations of the invention in this 
application can constitute them easily. 
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TECHNICAL PROBLEM 



[Problem(s) to be Solved by the Invention] Like a passenger car, by a car body's sinking or inclining with the entrainment number and 
the amount of loads, when the location and the image pick-up direction of image pick-up equipment differ from the parameter inputted 
or it was designed, in a place, they may happen frequently. Then, while running the road surface which has completely parallel lane space 
marks, for example, even if it is going to obtain the top view (bird s-eye view) from the upper part from an image pick-up and image 
transformation equipment, distortion will arise. 

[0004] This is shown in drawing 8 . As shown in (a) of d rawin g 8 , when the pitch angle Pc (the apparent vertical passing through the lens 
core of Camera C and angle which the image pick-up direction of a camera constitutes) of the camera C formed in Car M is alpha, the 
image pick-up image ((b) of drawing 8 ) presupposes that the processor is constituted so that it may become a right resolution picture 
((c) of drawing 8 ). That is, when the parallel lines on a road surface (a thick segment and broken line) are picturized, an resolution 
picture presupposes that it is adjusted so that it may become parallel lines. When the pitch angle of a camera becomes large with 
alpha+d alpha (dalpha> 0) or becomes small with alpha-d alpha (dalpha> 0) at this time, that image pick-up image becomes like (d) of 
drawing 8 , (a horizontal line H becoming a low location among an image pick-up image), (e), and (a horizontal line H becoming a high 
location among an image pick-up image). Then, since the approach of image transformation is to change into the frame of the screen of 
(c) of drawing 8 , (f), and (g) the field surrounded by the dotted line of (b) of drawing 8 , (d), and (e), the resolution picture of (d) of 
drawing 8 and (e) will become like (f) of drawing 8 , and (g). That is, an resolution picture did not become a top view (bird's-eye view) 
from the right upper part with the inclination of a car, but there was a problem that right information was not directed to an operator 
even if it outputs to image recognition equipment. 

[0005] Accomplishing this invention in order to solve the above-mentioned technical problem, the purpose is offering the image pick-up 
and image transformation equipment which were constituted so that the resolution picture amended by carrying out automatic 
amendment of the image pick-up direction of image pick-up equipment might be outputted. 
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MEANS 



[Means for Solving the Problem] In the image pick-up which has an image pick-up means, an image transformation means to change the 
image pick-up image of the image pick-up means, and to output an resolution picture, and an image analysis means to analyze an image 
pick-up image according to the means according to claim 1 in order to solve the above-mentioned technical problem, and image 
transformation equipment It is characterized by constituting so that the image pick-up direction parameter of the image pick-up means 
which an image transformation means has based on the analysis result of an image analysis means may be amended and the amended 
resolution picture may be made to output. This is shown in drawin g 1 (a) as a block diagram. In addition, as an image pick-up direction 
parameter, they are the locations (camera height etc.) of an image pick-up means, the angle (pitch angle) of the direction of an image 
pick-up core, and the straight line taken down downward [ vertical ] from the image pick-up means to accomplish, the angle (horizontal 
Bure angle) of those flat surfaces to make and the direction of a setting image pick-up core set up to accomplish, and angle of torsion 
of the image pick-up means centering on the direction of an image pick-up core. 

[0007] Moreover, an image transformation means to change the image pick-up image of an image pick-up means and its image pick-up 
means according to the means according to claim 2, and to output an resolution picture, In the image pick-up which has an image 
analysis means to analyze the resolution picture which the image transformation means outputs, and image transformation equipment It 
is characterized by constituting so that the image pick-up direction parameter of the image pick-up means which an image 
transformation means has based on the analysis result of an image analysis means may be amended and the amended resolution picture 
may be made to output. This is shown in drawing 1 (b) as a block diagram. In addition, as an image pick-up direction parameter, they are 
the locations (camera height etc.) of an image pick-up means, the angle (pitch angle) of the direction of an image pick-up core, and the 
straight line taken down downward [ vertical ] from the image pick-up means to accomplish, the angle (horizontal Bure angle) of those 
flat surfaces to make and the direction of a setting image pick-up core set up to accomplish, and angle of torsion of the image pick-up 
means centering on the direction of an image pick-up core. 

[0008] Moreover, according to the means according to claim 3, in an image pick-up according to claim 1 or 2 and image transformation 
equipment, it is characterized by attaching an image pick-up means in a car, and mainly picturizing a road surface. In addition, a road 
surface is not limited to the so-called road, but means all the fields where a car moves. That is, a parking field is included. 
[0009] Moreover, according to the means according to claim 4, an image analysis means presumes and extracts the parallel lines or the 
known graphic form on a road surface, and is characterized by determining the amount of amendments of the image pick-up direction 
parameter by analyzing the image pick-up image or resolution picture of these parallel lines or a known graphic form. Road surface-like 
parallel lines mean the road shoulder, lane space marks, a parking field partition line, etc., and a known graphic form means road surface 
dispplay of a circular manhole, a stop line, and a travelling direction and others etc. here, for example. 

[0010] Moreover, according to the means according to claim 5, an image analysis means is characterized by determining the amount of 
amendments of the image pick-up direction parameter by the rate measurement means of a car being interlocked with by analyzing the 
image pick-up image or resolution picture of an optical flow on a road surface. An optical flow means what is recognized by the image 
analysis means as what moves in an image pick-up image or resolution picture top here like the lane space marks of the shape of a 
broken line formed in the road surface. 

[0011] Moreover, according to the means according to claim 6, it has predetermined distance, two or more image pick-up means are 
arranged, and an image analysis means is characterized by determining the amount of amendments of the image pick-up direction 
parameter by analyzing the image pick-up image of the image pick-up means of these plurality, or the resolution picture by said image 
transformation means. 

[0012] Moreover, according to the means according to claim 7, it is characterized by for an attitude-sensing means to detect the 
direction of an image pick-up means being arranged by the image pick-up means, using together the direction parameter of the image 
pick-up means against the car which this attitude-sensing means detects, and determining the amount of amendments of the image 
pick-up direction parameter. An attitude-sensing means means the combination and others of a gyroscope, an acceleration detector, 
and a computing element here. 
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EXAMPLE 



The [1st example] Drawing 2 is the block diagram showing the configuration of the image pick-up concerning the 1st concrete example 
of this invention, and image transformation equipment 10. As shown in (a) of drawing 8 , it is carried in Car M, and the camera C which 
picturizes car back is assumed. The camera of drawing 2 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawi ng 1] The block diagram explaining the contents of claim 1 of this invention, and claim 2. 
[Drawing 2] The block diagram showing the configuration of the 1st concrete example of this invention. 
[ Drawin g 3] The flow chart which shows the procedure of the 1st example. 

[Drawing 4] The physical relationship Fig. for explaining the contents of an operation of the 1st example. 
[Drawin g 5] The physical relationship Fig. for explaining the 2nd example. 

[Drawing 6] The conceptual diagram showing the image pick-up image for explaining the 3rd example. 

[Drawing 7] The conceptual diagram showing the image pick-up image and bird's-eye view image for explaining the 5th example. 
[ Drawing 8] The explanatory view showing the gap of a pitch angle when not amending, and the relation of a bird's-eye view. 
[Description of Notations] 
M Car 

C A camera and a camera location 

G Road surface 

Pc Camera pitch angle 

H The image pick-up image of a horizontal line 

P The camera image pick-up angle of the lengthwise direction incorporated by the bird's-eye view image 
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